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AUTONOMOUS SYNTHETIC CHARACTERS 

10 

Inventors : 
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15 Timothy W. Bickmore 

Joseph W. Sullivan 
Elizabeth Churchill 
Scott A. Prevost 

20 

COPYRIGHT NOTICE 
A portion of the disclosure of this patent 
document contains material which is subject to 
25 copyright protection. The copyright owner has no 
objection to the facsimile reproduction by anyone of 
the patent document or the patent disclosure, as it 
appears in the Patent and Trademark Office patent file 
or records, but otherwise reserves all copyright rights 
30 whatsoever. 

Packground q£ the in ve ntion 

Field Qt the invention 
35 This invention relates to human- computer 

interfaces (HCI) . The invention is more particularly 
related to a tool set for modeling and creation of a 
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personality for an animated anthropomorphic character 
HCI that interacts with a user. The invention is even 
more particularly related to a tool set that allows the 
inclusion of new and the modification of existing 
5 personality attributes to produce a unique and engaging 
anthropomorphic character personality. 

Discussion of the Background 

Autonomous synthetic computer characters have 

10 become a technological and commercial reality in the 
last few years, both as alternative user interface 
mechanisms and as entertainment devices. The Microsoft 
Office Assistant, Microsoft Agent, IBM's Warp Guide, 
and Extempo's Imp Software are all recent attempts to 

15 commercialize user interface technology developed over 
the last decade at academic research institutions- The 
explosion in computer games which utilize synthetic 
characters and their increased use in television and 
motion pictures also indicate a strong demand for 

20 advances in this technology. 

One such advance is the basic action selection 
architecture (BASA) developed in the ALIVE project at 
the MIT Media Lab. The BASA is used for run- time 
25 simulation of characters in deliverable applications. 

In the BASA, behaviors are arranged in a hierarchy 
with those at the top of the hierarchy being more 
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abstract categories of behavior and those at the bottom 
being operational in that they have simulation routines 
associated with them which allow the character to 
perform them when commanded. Behaviors at each level 
5 in the hierarchy compete every time step of the 
simulation for control of the character. The result of 
this competition is one primary behavior, which is the 
primary action the character performs at that time 
step. 

10 However, most of the research and development in 

this area to date has been on realistic rendering, 
real-time animation, and "functional" autonomous 
behavior, while the issue of character personality is 
typically left for an animator or script writer to 

15 fashion in an "artistic" (i.e., unprincipled) manner. 
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SUMMfiRY QF THS INVENTION 
The present inventors have realized the need to 
utilize personality in efforts to develop better 
synthetic characters, and the need for a method to 
5 apply personality to synthetic characters. The 
present inventors have also realized that the 
application of certain personality traits to synthetic 
characters can make the synthetic characters more 
engaging, and more quickly accepted by users, easing 
10 the learning and familiarization process of an 
application to which the synthetic characters are 
applied. 

Accordingly, it is an object of the present 
invention provide developers a workbench for developing 

15 and creating personalities for synthetic characters. 

It is another object of the present invention to 
provide a workbench that allows personality traits to 
be programmed into a synthetic character developed for 
an application within a BASA-like architecture. 

20 It is yet another object of the present invention 

to modify a behavioral hierarchy of a BASA architecture 
and provide for the selection of primary and non- 
conflicting secondary behaviors implementing 
personality traits of a character profile. 

25 The present invention describes a system for 

designing recognizable personalities in synthetic 
coit^uter characters in order to better engage users. A 
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personality design workbench enables designers to 
describe personality attributes that modify a 
behavioral hierarchy, particularly useful for 
characters created in a simulation environment having 
5 a reactive action selection architecture. These 
systems may be utilized to build applications for 
conversational characters (anthropomorphic user 
interfaces) and for entertainment purposes. 

Typically, known characters share the same 

10 behavioral sets and display only minimal, if any, 
inter- character individuation. To broaden personality 
expression in such characters (individuation) , the 
personality design workbench outputs a set of 
'personality effectors* able to modify a prescribed set 

15 of behaviors within a BASA behavioral hierarchy to 
clearly portray uniquely different character 
personalities , 

These and other objects are accomplished by a 
system for rendering personalities for synthetic 

20 characters, including a personality trait selection 
device that , displays at least one selectable 
personality trait, and a personality builder that 
groups the selected personality traits into a character 
profile . 

25 The personality trait selection device may include 

trait indicators (graduated dials, for example) , each 
trait indicator representing an amount of a 
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corresponding one of the selectable personality traits. 
The personality builder weights each selected 
personality trait in said character profile according 
the amount of each selected personality trait 
represented in the corresponding trait indicator. 

The system may also include a personality 
attribute selection device that displays at least one 
selectable personality attribute, and a mapper 
configured to map each selected personality attribute 
into amounts of the trait indicators according to an 
amount each selected personality attribute is 
represented in the selectable personality traits. 

The invention includes a method of selecting 
behavior for a synthetic character, comprising the 
steps of computing a primary activation level of 
primary behaviors in each of plural nodes at a given 
level of a modified behavior hierarchy, selecting a 
node having a highest activation level, and executing 
the primary behavior in accordance with an action 
defined by the selected node. The method may include 
selecting a secondary behavior level, and discarding 
the secondary behavior if it conflicts with a selected 
primary behavior. 
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PRIBF pgSCRIPTIQN QF THB DRAWINGS 
A more con^lete appreciation of the invention and 
many of the attendant advantages thereof will be 
readily obtained as the same becomes better understood 
5 by reference to the following detailed description when 
considered in connection with the accompanying 
drawings, wherein: 

Figure 1 is an overview of a process for utilizing 
a workbench for developing a personality to be applied 
P 10 to one or more synthetic characters; 

i"U Figure 2 is an example of a behavioral hierarchy 

'^^-J useful for a conversational character; 

^? I 

|*y Figure 3 is a diagram illustrating influences on 

a behavior for determination of a behavior activation 
.S 15 level; 

•J Figure 4 is a classification hierarchy of 

personality effectors for implementing character 
traits; and 

Figure 5 is a block diagram of one embodiment of 
20 a device for rendering a personality. 



Attorney Docket No.: FUJI-XERX1018/MCF/ JWC 
jwc/fuji-xerx/ 1018/101 8- 001 



Express Mail No. 
TB597445948US 



m m 

-8- 

PESCRTPTIQN OF THE PREFERRED EiyEBQDIlXENTS 

The present inventors have realized that a 
consistent, readily- identifiable personality is 
crucially important in synthetic character applications 
for at least the following reasons: 

• Personality helps to engage the user. Both 
anthropomorphic interfaces and entertainment 
applications require that the user "suspend 
disbelief" while using them. A character with a 
well -designed personality can not only attract users 
into using a system but can help maintain the 
illusion that they are interacting with a real 
entity, 

• Personality facilitates user identification with the 
character in "ally" interfaces. In Conversational 
Character systems in which the character acts as the 
user's ally in using a complex system, a properly 
designed personality can increase the user's sense of 
allegiance with the character. 

• Personality can be used to establish the user's 
expectations about the system. A character with a 
dominant personality will be expected to lead the 
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user in mixed- initiative interactions; a submissive 
character will be expected to do the opposite. 

• Personality can be used to control the user's style 
5 of interaction with the system. An immature or 

child- like character can be used to subconsciously 
coax the user into speaking slowly to accommodate 
imperfections in the speech recognition system. 

• Personality can be used to control the user's 
10 affective response to the system. People have 

affinity for others who have personalities similar to 
theirs and even greater affinity for those who modify 
their personality to be more like them. Such 
phenomena could be leveraged to make users like a 
15 particular product more than they would otherwise. 

• Personality is central for entertainment 
applications . Personality is central to character 
development which is crucial to any story upon which 

20 an entertainment system may be based. 

The present inventors have realized that 
personality may be utilized as an additional tool to 
develop better synthetic conversational characters and 
25 consequently better software applications. At a 
minimum, conversational characters provide a more 
familiar mode of communication for users D enabling the 
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character to have a more congenial relationship such as 
a mentor or assistant to the user. The capacity to 



personalities can produce not only richer applications 
but also considerable design enhancements for the 
developer. 

Users will find personable synthetic characters to 
be more engaging, more comfortable and ultimately 
easier with which to work. The benefits for fielded 
applications are clearly evident: ease of learning and 
tool familiarization, more ready acceptance by users 
and an application that is more highly regarded. From 
a design perspective, developers can more readily 
tailor multiple versions of an application for 
different classes of user and experiment with different 
aspects of personality to improve engagement with or 
enhance user acceptance of new applications. 

The present inventors have developed a novel 
approach to modeling personality. The model is the 
basis for a personality design workbench that assists 
developers in creating personable characters and also 
underlies a personality engine that realizes design 
specifications within character behavior. The design 
process, workbench and character realization are 
schematically depicted in Figure 1. 

The personality design workbench (personality 
workbench, or simply workbench) outputs characters 
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which are constructed to be used within a specific 
reactive action selection architecture designed for 
autonomous synthetic character applications (BASA 
architectures, for example) . The personality workbench 
5 may also output characters for other (or multiple) 
architectures. The specific reactive action selection 
architecture is ethological in origin and models how 
characters choose their behaviors based on constructs 
such as internal and external states, releasing 
10 mechanisms, inhibition and fatigue. Behavior selection 
at each cycle in the system is determined by the 
outcome of a summative relationship between these 
factors in a 'winner take' all competition that ensures 
that the character maintains coherency in its behavior. 

15 

The two problems addressed by the personality 
design workbench are: 

1) how should personality be specified by a 
character designer; and 
20 2) how to map from the desired personality 

specifications to the selection of character behaviors 
such that those behaviors will clearly reflect the 
intended personality. 

The present invention presents a method for 
25 formalizing personality expression by drawing on 
research from two disciplines: personality trait theory 
and human communication theory. Trait theory suggests 
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that people clearly communicate notions of personality 
with descriptive, trait -like words found in their 
cultural lexicon. These personality-based linguistic 
constructs or 'labels' are used by people to both 
5 describe and classify people based on behavioral 
similarities. Research has clearly demonstrated that 
traits are highly stable predictors of future behavior, 
that people use only the features associated with a 
small set of traits when classifying individual 

10 personalities and there is a high degree of consensus 
about the typical behavioral descriptors associated 
with specific traits. For example, most people 
describe introverts as being quiet, shy and retiring.. 
It is clear, however, that the descriptors 'quiet, shy 

15 and retiring' do not provide sufficient data upon which 
to create an introverted character. 

In human communication theory, personality is seen 
as part of a dynamic, communicative process - it is 
both emitted (or encoded) by an individual and 

20 subsequently 'decoded' by a viewer. As encoders, 
humans display aspects of their personality across 
multiple independent channels which tend to be 
predominantly nonverbal in nature (e.g., posture, gross 
body movement, facial and eye expression, or hand 

25 gestures) . Likewise, as decoders humans read from and 
combine information across multiple channels to form an 
overall impression of both the person and their 
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message. Thus, research has shown that introverts tend 
to display the following kinds of behavior: they speak 
little and only when spoken to, they assume a closed 
body posture and they tend to avoid eye contact. If a 
5 person (or an embodied character) were to display these 
behaviors they would be labeled as introverts. Our 
methodological approach is thus to isolate a basic set 
of personality traits and trait indicative nonverbal 
and verbal behaviors (i.e. people believe the behavior 

10 reflects a specific trait) , and, finally translate 
those behaviors into classes of 'personality 
effectors* that can modulate a character's behavioral 
expression within the simulation environment so as to 
reflect the desired set of traits. 

15 There have been a number of research projects 

examining personality from two perspectives: the 
effects of personality on non- anthropomorphic interface 
design (User Interface Design) and the impact of 
personality on agent behavior in interactive > fictional 

20 worlds (Interactive Worlds) . 



User interface design 

IBM's software agent WarpGuide is an agent- 
oriented task guide that assists people with system 
25 tasks. It employs a personality (intelligent, friendly 
and unobtrusive) that was deemed task- appropriate (i.e. 
a mentor) , a weak physical rendering of that 
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personality (i.e, text boxes with rounded corners, warm 
colors) and a message content that was biased along the 



suggested users responded positively to the 
characterization. However, since the actual interface 
was limited to text, these "agents" did not address the 
use of multiple simultaneous channels for conveying 
personality (including, in particular, human trait- 
indicative non-verbal behaviors) . 

Jnteractive worlds 

In The Virtual Theater project at Stanford, use a 
social -psychological model of personality. However, it 
has many deficiencies: 1) it is only able to select one 
behavior per time step (simultaneous use of multiple 
channels is not possible) ; 2) the basic action 
selection approach is severely impoverished (no 
perception, no coherence of action, and boredom/ fatigue 
is modeled by randomization) ; 3) no provision 
integrating more complex, deliberative behavior (e.g., 
task planning, face- to- face communicative behavior) ; 4) 
use of traits and non-verbal behaviors is ad-hoc; and 
5) personality models are difficult and confusing to 
author, and difficult to predict given that traits can 
change over time. 

Both the OZ project at CMU and the Affective 
Reasoner project at DePaul use a cognitive model of 
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emotion based on Ortony. The emotion module in OZ 
reasons over recent events and the agent's goals to 
create an emotional interpretation of the current 
status of the system. Emotions are generated by 
5 comparing an event outcome to an agent ' s current goals 
goals succeed/fail which result in happy/sad 
emotional states) . The emotional interpretation (if 
any) is returned to the behavior engine for use in 
selecting the agent's next behavior - allowing emotion 

10 to play a role in behavior selection. Elliot's 
Affective Reasoner uses the same emotion model as OZ 
but gives agents a rudimentary personality using two 
related constructs: disposition and temperament. 
Disposition is an 'interpretive' personality construct 

15 that enables agents to differentially interpret events. 
Temperament is the 'manif estive ' component of 
personality that guides an agent's expression of 
emotional state in its behavior. Neither of these 
approaches utilize a trait-based specification of 

20 personality nor trait- indicative non-verbal behaviors. 
The Oz project utilized very primitive synthetic 
characters which could only exhibit one behavior at a 
time (multiple simultaneous channels are not 
available) ; the Affective Reasoner is a text -only 

25 system. 

The present invention has the following features: 
1) An approach based on extensions to an ethologically- 
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correct action selection architecture; 2) the 
personality "workbench" provides multiple simple 
authoring mechanism; 3) all information about 
personality and its behavioral effects are encapsulated 
5 with a character; 4) a character can portray persistent 
trait- indicative non-verbal behaviors through 
"persistent personality effectors"; 5) a character can 
portray conditional and temporally -bounded trait - 
indicative non-verbal behaviors through "episodic 

10 personality effectors"; 6) a character can portray 
trait- indicative actions in response to user actions 
through "reactive personality effectors"; 7) a 
character can modulate how it performs actions via 
"modulating personality effectors"; 8) a character can 

15 alter its perception and assessment (construal) of 
situations in its environment through "construal 
personality effectors"; 9) the workbench will suggest 
non-behavioral modifications to the physical design of 
the character; 10) characters can use multiple 

20 simultaneous communication channels to project 
personality; 11) the selection of traits and non-verbal 
behaviors used are based on research in psychology and 
communications; and 12) personality is presented as 
indigenous to a character. 



Attorney Docket No.: FUJI-XEFOC1018/MCF/ JWC Express Mail No. 

jwc/fuji-xerx/1018/ 1018. 001 TB5974 4594 BUS 



17 




- 17- 

1. The approach Is based on extensions to an 
ethologically- correct action selection architecture. 

The "personality workbench" produces extensions 
and modifications to a basic action selection 
5 architecture . This architecture ensures natural , 
coherent behavior while allowing for multiple, 
simultaneous actions, based on the character's 
perception of its environment, internal state and level 
of boredom and fatigue. This model can be readily 
10 extended to perform deliberative actions such as task 
planning . 

2 . The personal i ty "workbench " provides mul tipl e 
simple authoring mechanism. 

15 Character designers can specify personality either 

by direct manipulation of trait values (e.g*, a value 
between -10 and +10 on the warm/cold dimension) , 
through the selection of desired trait attributes 
(e.g., a character which is kind, sympathetic, soft- 

20 hearted and affectionate) , or via selection of desired 
non-verbal behaviors (e.g., makes frequent and 
expansive gestures) . Limited editions, combinations, 
and variations of the above mechanisms are also 
envisioned. 
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3. All informcLtlon about personality and its 
behavioral effects is encapsulated within a character. 

Trait -indicative nonverbal signaling behaviors and 
mechanisms for personality-biased modulation of 
5 behavior are organized in a set of modular data 
structures. These data staructures, called "personality 
effectors", enable multi-faceted personality expression 
which is enduring, consistent and predictable across 
time and events. 

10 

4. A character can portray persistent trait -indicative 
non-verbal behaviors through "persistent personality 
effectors " 

Personality descriptions are used to select non- 
15 verbal behaviors that act as "default" behaviors for 
the character. They are subtle, have a high frequency 
of occurrence and will always be expressed whenever 
^ they do not conflict with the primary behavior the 
character is executing. Examples are body posture 
20 (e.g., slumped) and facial expression (e.g., frown). 

5. A character can portray conditional and temporally- 
bounded trai t - indi ca ti ve non - verbal behavi ors through 
"episodic personality effectors" 

25 Like persistent behaviors these are largely 

nonverbal in nature and unconscious. Unlike 
persistent behaviors they appear only periodically. 

Attorney Docket No.: FUJI-XERX1018/MCF/ JWC Express Mail No. 

jwc/fuji-xerx/1018/1018. 001 TB5974 4 594 8US 





- 19- 

under well specified time constraints and are 
competitive with other behaviors for activation. 
Examples are self -face touching as a signal of 
nervousness and gaze avoidance as a signal of 
5 submissiveness . 

6. A character can portray trait -indicative actions in 
response to user actions through "reactive personality 
effectors" . 

10 For task-oriented application domains in which the 

character and user have goals they are trying to 
achieve, the worlcbench will produce behaviors which 
enable the character to respond in a trait- indicative 
manner to actions taken by the user. Examples are 

15 facial flush (submissive) or violence (dominant) when 
the user thwarts a goal of the character , 



7. A character can modulate how it performs actions 
via "modulating personality effectors" . 

20 Modulating personality effectors change how the 

character performs a given action. These are 

essentially hints to the various behavior routines 
which suggest, for example, that if the character needs 
to walk it should walk decisively (dominant) or 

25 neirvously (tense) . These effectors can also modify the 
performance of linguistic components of conversational 
characters by effecting word choice and sentence 
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structure decisions {e.g., "Could you possibly spare 
something to drink?" vs. "Give me some water!"). 
Modulating effectors can also be systemic in that they 
effect how the action selection architecture itself 
5 functions by modifying the amount of deliberation 
performed by the system, the boredom and fatigue decay 
rates, etc. 

8. A character can alter its perception and assessment 
10 (construal) of situations in its environment through 

"construal personality effectors" . 

Different personality types see the world 
differently. For example, tense character will react 
more rapidly to an approaching user than a relaxed one 
15 will. 

9. The , worJcbench will suggest non- behavioral 
modifications to the physical design of the character. 

These suggestions include both invariant physical 
20 features (body type, facial structure) , variable 
personal artifacts, and suggestions for designing the 
character's setting (furniture, etc.). 

10. Characters can use multiple simultaneous 
25 communication channels to project personality. 

Nonverbal behaviors appear in multiple, readily 
identifiable channels (i.e. face, posture, etc.), they 
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can be expressed in parallel (appear in two or more 
channels simultaneously) and often carry redundant 
messages . Having multiple concurrent communication 
channels through the use of secondary behaviors will 
5 affect character- to -human communication in several 
fundamental ways : 

• Additional information channels broaden the 
communication bandwidth and thus increases the amount 

10 of information being conveyed at any one point. 

• Cross channel message redundancy or the tendency for 
more than one channel to carry the same message 
increases the probability that a character will be 

15 compatible with a wider range of users. For example, 

men tend to look more closely at hand gestures while 
women track eye behavior and facial expression. 
Concurrent channels that carry the same message will 
reach a broader audience. 

20 

• Characters who express personality using trait - 
indicative nonverbal behaviors closely mimic how 
humans tend to encode their own communicative 
messages and to decode the messages of others. This 

25 increased compatibility (or match) between a 

character and an end-user will have a number of 
benefits : 
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• An increase in the engagement level of an end -user 
resulting in shorter learning curves. 

• Increased trust or confidence in a character's 
5 ability to assist an end-user (i.e. end-users come 

to see the character as an 'ally' rather than a 
part of the complex system with which they are 
working) . 

10 • End users will value the technology more highly 

(Reeves and Nass) . 

11. The selection of traits and non-verbal behaviors 
used are based on research in psychology and 

1 5 conmuni ca ti ons . 

The traits, trait attributes, and associated 
verbal and non-verbal behaviors used in the personality 
workbench are all based on psychology and human 
communication research . 

20 

12. Personality is assumed to be indigenous to a 
character. 

The present invention presents a personality 
wholly integrated across all aspects of character 
25 realization including subsystems for appraisal, 
reactive behavior selection, persistent and episodic 
behavior selection and modulation. All subsystems act 
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in accordance to present a pervasive, robust and 
consistent personality that remains intact over time. 

The personality of a character is created in a 
design phase and leaves the workbench with a set of 
5 fully integrated personality attributes. This is 
unlike other approaches which have expressed character 
personality in an ad- hoc and piecemeal fashion. 
Character behaviors in other systems are isolated and 
appear without coordination in nonparallel behavioral 
10 subsystems. In short, personality expression in the 
other approaches is non- systemic and results in 
characters that appear shallow and unconvincing. 

Technical Details 

15 The "personality workbench" produces extensions 

and modifications to the basic action selection 
architecture. The architecture uses an ethological 
approach that ties behavior selection to traditional 
animal -world constructs, and may be extended to 

20 modeling human deliberative behavior. 

The behaviors within a BASA are arranged in a 
hierarchy, as shown in Figure 2. Behaviors are 
activities which the character can perform, with those 
at the top of the hierarchy being more abstract 

25 categories of behavior and those at the bottom being 
operational in that they have simulation routines 
associated with them which allow the character to 

Attorney Docket No.: FUJI-XERX1018/MCF/ JWC Express Mail No. 

jwc/fuji-xerx/1018/1018 . 001 TB597 4 4 594 8US 





-24- 



perform them when commanded. Behaviors at each level 
in the hierarchy compete every time step of the 
simulation for control of the character. The result of 
this competition is one primary behavior, which is the 
primary action the character is performing, and 
secondary behaviors. The secondary behaviors are 

executed as long as they do not conflict with the 
primary behavior (where 'conflict' is defined with 
respect to the character simulation controls) . Thus, 
the architecture supports the simulation of multiple 
parallel activities while maintaining a notion of 
behavioral focus . 

Behaviors from each level are selected based on a 
computation of activation level and competition with 
sibling behaviors. The factors which go into the 
calculation of activity level are (see Figure 3) : 

• Endogenous variables. These correspond to internal 
states such as blood sugar level, hormone levels, 
hunger or thirst. Modeled as a continuous variable 
where a sufficiently high value helps influence the 
selection of a behavior (drinking in response to 
thirst) . 

• External states and releasing mechanisms. External 
states are events or objects detected in the 
environment by sensors. Releasing mechanisms are 
'perceptual interpretations' of external stimuli that 
signal an object or event is iinportant to the agent. 
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• Inhibition and fatigue (level of interest) . When 
behaviors compete amongst each other they do so on 
the basis of each behavior's activation level and 
inter-behavior inhibition. The activation value is 
determined in part by the endogenous variables and 
releasing mechanisms described previously. These two 
factors cannot determine the right amount of 
persistence (i.e. too much dithering between multiple 
behaviors) nor account for opportunistic responses 
(i.e. not persisting in one behavior to the exclusion 
of other goals) . To model persistence, competing 
behaviors are assumed to be mutually inhibiting - 
some behaviors can post a higher gain for performance 
relative to others. The higher the gain, the 

greater the persistence. Modeling opportunistic 
behaviors requires some notion of time- sharing among 
activities. The construct of fatigue assumes that 
when a behavior is selected as primary, its level of 
fatigue will increase proportionally over time, which 
will reduce the overall activation value of that 
behavior. When the value of the current primary 
behavior falls below that of a competing behavior the 
competing behavior will become primary. 

This architecture can be further extended to 
simulate elements of human deliberative behavior. In 
one embodiment, such extension is performed by coupling 
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the architecture with a task planner. When a plan has 
been produced, it can be used to bias the activation 
level for the behavior (s) corresponding to the next 
step(s) in the plan when their preconditions are 
5 satisfied. In this way, the reactive action selection 
architecture can be used as an intelligent plan 
execution environment, in which unplanned behaviors can 
still be performed opportunistically if warranted. 

We summarize the features of a reactive behavior 
10 selection architecture that are particularly amenable 
to expressing an integrated personality through trait - 
indicative behavior selection. 

• Behaviors are organized in loose hierarchies with 
the leaf nodes in the hierarchy containing 

15 character simulation information (i.e. the 

directions about how to move the 'muscles' of the 
character to perform the behavior) , 

• Character simulation information is described in 
20 terms of specific 'degrees of freedom' which refer 

to the points on the character's body that can be 
moved. (These are a fixed set of points and 
generally correspond to the joints of the 
character's body.) Having a character make an 
25 expansive beckoning gesture with its arm requires 

the use of three degrees of freedom - the elbow, 
wrist and shoulder. 
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• At any point in time a character will be engaged 
in only one activity called a primary behavior. 
The primary behavior has uncontested access to 
those degrees of freedom that it needs to perform. 

5 

• One or more behaviors (called secondary behaviors) 
can execute simultaneously with the currently 
selected behavior if the following are true: 

1. The value of the secondary behavior is 
10 sufficiently high. 

2 . The degrees of freedom necessary to perform 
the , secondary behavior are currently 
available (i.e. not being used) . 

15 Personality Design 

Characters emerging from the personality design 
workbench have trait profiles that will generate 
individuated characters. In a primary embodiment, 
character trait profiles are made up of a set of five 

20 bi -polar traits each of which varies along a continuous 
dimension. The five primary traits are the standard 
"Big Five" traits used most in personality theory 
research (see Table 1) . 



Attorney Docket No. : FUJI-XERX1018/MCF/ JWC 
jwc/fuji-xerx/1 018/1018- 001 



Express Mail No. 
TB597445948US 





• 



(X 



0 



10 



28 



TJ^Bh^ X. Trait Indices Used In 



Primary Traits 



Dominant / Submi s s i ve 



Warm/Cold 



Conscientiousness 



Emotional Stability 



Openness 



15 



The workbench allows designers to create 
personality profiles for a character in three different 
ways. . For example, in one embodiment: 



1. For each of the traits, the designer can 
position a graduated dial at an arbitrary point between 
two anchors (i.e. a highly warm character would have 

20 the dial set very near the 'warm' anchor point on the 
dial) . Designers must set at least two of the primary 
personality traits for each character. Primary traits 
not set by the designer are arbitrarily given default 
neutral settings that point in the middle of the 

25 anchors. A trait with a neutral setting means that the 
trait would not be readily inferred from the 
character's behavior (i.e. behaviors indicative of 
neutral -rated traits can appear in a character's 
behavior but not with a frequency that would be 

30 recognized by users.) 
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2 . The designer can select personality attributes 
they want their character to manifest. Personality 
attributes are linguistic labels which describe 
attributes typically associated with each trait anchor 

5 end-point (e.g., »warm* attributes include kind, 
sympathetic, soft-hearted, affectionate) . The 
Personality Workbench will then map these selected 
attributes into a trait profile which can then be 
edited using method 1 above. 

10 

3. The designer can select a set of trait - 
indicative behaviors that she wants the character to 
perform. For example, a designer may not know what she 
wants in terms of a trait profile or attributes, but 

15 knows that she wants character which performs gesturing 
behaviors that are expansive and highly frequent. The 
Personality Workbench will then map these selected 
behaviors into a trait profile which can then be edited 
using method 1 above. 

20 

Personality Effectors 

The Personality Workbench translates the trait 
profiles for a character into the following personality 
effectors which modify the behavior of the basic action 
25 selection architecture described above (for example, 
any method that would convey behaviors associated with 
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the character) . A classification hierarchy of the 
personality effectors is illustrated in Figure 4. 

Persistent personality effectors . These are new 
5 behaviors added to the hierarchy for the character 
being designed. Persistent nonverbal behaviors have a 
constant activation value (i.e. are always 'on'), are 
not subject to decay (or fatigue) over time, and can 
never be selected as primary behaviors (i.e., can only 

10 be used as secondary behaviors) . They function as 
default behaviors as they will always be expressed if 
the necessary simulation controls for expression are 
available (i.e. not currently being used by the primary 
behavior) . Thus, persistent behaviors are constantly 

15 opportunistic - if the conditions are favorable they 
will always execute. For example, an introverted 
character may always exhibit a slumped posture unless 
it needs to reach something. 

20 Episodic personality effectors . These are new 

behaviors added to the hierarchy for the character 
being designed. These behaviors are similar to 
persistent behaviors in that they represent trait - 
indicative nonverbal behaviors and can never be 

25 selected as primary behaviors (they represent 
'unconscious' non- deliberative actions on the part of 
the character) . However they act like other behaviors 
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in the behavioral hierarchy in that their activation 
values can fluctuate in response to environmental 
stimuli (unlike persistent behaviors) . For example, 
introverts tend to display gaze avoidance behavior, but 
5 displaying that behavior only makes sense in the 
presence of others. 

i^eactive personality effectors. These are new 
behaviors added to the hierarchy for the character 

10 being designed. These behaviors are domain- dependent , 
full-fledged additions to the behavior hierarchy for a 
given application (i.e., they can have endogenous 
influences, releasing mechanisms, and level -of -interest 
functions) , and represent the set of personality- 

15 specific, deliberative actions that a character may 
take in response to a given situation. For example, a 
dominant character may respond with a violent behavior 
in response to a goal -obstruction, whereas an 
introverted character may only blush. 

20 

Modula-ting- personality effectors . These act as 
hints to the action selection system, affecting how 
different functions are performed rather than what 
functions are performed at any given time. There are 
25 three kinds of modulating effectors: 1) behavioral, 
which effect how a given behavioral simulation is 
executed (e.g., the *walk* simulation may be modified 
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to perform 'walk happily', 'walk timidly*, 'walk 
boldly', or 'walk sadly'); 2) linguistic, which effect 
how the language synthesis parts of a Conversational 
Character system function (i.e., effecting word choice 
5 and sentence structure) ; and 3) systemic, which impacts 
the overall action selection system (e.g., trading 
deliberation vs. action for a conscientious character, 
increasing boredom/ fatigue rates for happy-go-lucky 
characters, etc.) . 

10 

Constjrua.! or appraisal functions. Personality can 
modify a character's interpretation of world events. 
In an ethological model this would require 
modifications in the form of increased or decreased 

15 gains on existing releasing mechanisms or adding new 
releasing mechanisms to existing behaviors. For 
example, a more submissive person would detect a 
dominant person sooner and would react accordingly in 
their presence (i.e. displaying submissive behaviors). 

20 At a deeper, psycho- sociological level, appraisal 
functions determine the character's assessment of 
actions taken by others and its impact on the 
character's affective state (endogenous variables), and 
is driven, at least in part, by the character's 

25 personality. 
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Non- behavior a.1 effectors. Characters will have a 
physical presence for which viewers will infer 
personality characteristics. These features are 
physical in nature and are apparent throughout the 
lifetime of the character* Some examples include: 
body type (endomorph, ectomorph, mesomorph) , facial 
structure (round/ triangular face) , attractiveness, and 
physical objects that the character may surround itself 
with (furniture, art, etc.). The initial version the 
Personality Workbench will simply popup a window with 
suggestions regarding appearance factors; future 
versions may actually be able to modify the character's 
3D design. 

Figure 5 is a block diagram of one possible 
implementation of a device for rendering a personality. 
A behavior hierarchy is created or modified by a 
modifier 510. The modifier may include a device such 
as the personality workbench illustrated in Fig. 1. 

The behavioral hierarchy 52 0 provides information 
on primary and secondary behaviors, modulation, and 
construal personality effectors, which are each 
interpreted by appropriate decices (primary activation 
device 552, secondary activation device 554, modulator 
540, and construal device 53 0, respectively) . Each of 
these devices provide inputs (specific action or amount 
of movement in a gesture, for example) to the 
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activation device regarding behaviors consistent with 
and effecting the information in the behavioral 
hierarchy. 

A construal device 530 receives external stimuli 
5 500 and provides an interpretation of that stimuli to 
the activation device 550. The activation device 550 
selects non- conflicting behaviors and considers 
external significance of external stimuli, and notifies 
a behavior execution module 560 of a selected behavior. 

10 At this point, it is worthwhile to review some 

features of the present invention. The present 
invention allows a personality profile from a design 
phase (such as the output of the personality worlcbench 
described in FIG, 1) which is then translated into a 

15 new behaviorial heirarchy via a set of personality 
effectors. The new personality is an individuated 
behavioral hierarchy produced with personality biased 
behaviors, including, primary and secondary behaviors, 
modulated pre-existing behaviors, and construal 

20 changes. The new behavioral hierarchy is created at 
compile time (i.e., before the character is running), 
and has the capability to (1) add new behaviors 
(primary and secondary) , (2) modulate existing 
behaviors in an existing hierarchy, and (3) modify a 

25 character's perception of external events. 

Then, at run time, personality expression is 
accomplished in the following ways: 
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(1) Parallel use of secondary behaviors as a way 
of expressing differences between characters having a 
same primary behavior (the secondary behaviors grabbing 
free DOFs for an available for instantiating the 

5 secondary behavior) ; 

(2) The use of new trait indicative primary 
behaviors, along with their own internal releasing 
mechanisms, that were added via the personality 
profile; and 

10 (3) Modulation of existing behaviors in the 

hierarchy, and/or perceptual and interpretive changes 
according to the personality profile. 

The present invention as discussed herein has been 
described in reference to rendering a personality and 

15 methods and devices utilized in rendering a 
personality, preferably for synthetic characters. 
However, the teachings of the present invention may be 
applied to numerous other endeavors, including 
equipment for suggesting behaviors for humans, actors, 

20 electronic equipment, voice boxes, announcement 
devices, or other devices not necessarily associated 
with a synthetic character. In addition, the teachings 
of the present invention apply to any type of animated 
interface or presentation device (virtual classroom 

25 instructor, or tutor, for example) or other animated 
devices or icons . The present invention may be 
utilized in a computer interface or for directing 
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operations of any type of equipment of varying 
configurations (televisions , VCR ' s , stereos , radar 
devices, toys, mechanical equipment such as heavy 
machinery, and building management /maintenance devices 
5 as just a few examples) , 

The present invention may be conveniently 
implemented using a conventional general purpose or a 
specialized digital computer or microprocessor 
programmed according to the teachings of the present 

10 disclosure, as will be apparent to those skilled in the 
computer art * 

Appropriate software coding can readily be 
prepared by skilled programmers based on the teachings 
of the present disclosure, as will be apparent to those 

15 skilled in the software art. The invention may also be 
implemented by the preparation of application specific 
^ integrated circuits or by interconnecting an 
appropriate network of conventional component circuits, 
as will be readily apparent to those skilled in the 

20 art . 

The present invention includes a computer program 
product which is a storage medium (media) having 
instructions stored thereon/in which can be used to 
program a computer to perform any of the processes and 
25 methods of the present invention. The storage medium 
can include, but is not limited to, any type of disk 
including floppy disks, optical discs, DVD, CD-ROMs, 
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microdrive, and magneto- optical disks, ROMs, RAMs, 
EPROMs, EEPROMs, DRAMs , VRAMs, flash memory devices, 
magnetic or optical cards , nanosystems ( including 
molecular memory ICs) , or any type of media or device 
5 suitable for storing instructions and/or data. 

Stored on any one of the computer readable medium 
(media) , the present invention includes software for 
controlling both the hardware of the general 
purpose/specialized computer or microprocessor, and for 

10 enabling the computer or microprocessor to interact 
with a human user or other mechanism utilizing the 
processing of the present invention. Such software may 
include, but is not limited to, device drivers, 
peripheral equipment programs, operating systems, and 

15 user applications. Ultimately, such computer readable 
media further includes software for performing the 
functions of the present invention as described above. 

Included in the programming (software) of the 
general/specialized computer or microprocessor are 

20 software modules for implementing the teachings of the 
present invention, including, but not limited to, input 
and identification of user inputs, selection of 
personality traits , building a character profile , 
computing activation levels, and selection and 

25 activation of personality behaviors including 
movements and speech of a synthetic character or other 
animated character, voice, or display. 
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Obviously, numerous modifications and variations 
of the present invention are possible in light of the 
above teachings. It is therefore to be understood that 
within the scope of the appended claims, the invention 
may be practiced otherwise than as specifically 
described herein. 



Attorney Docket No.: FUJI-XERX1018/MCF/ JWC 
jwc/f uj i-xerx/1018/1018 . 001 



Express Mail No. 
TB597445948US 



